florida institute
End-to-End Imitation Learning for Optimal Asteroid Proximity Operations
Quinn, Patrick, Nehma, George, Tiwari, Madhur
Controlling spacecraft near asteroids in deep space comes with many challenges. The delays involved necessitate heavy usage of limited onboard computation resources while fuel efficiency remains a priority to support the long loiter times needed for gathering data. Additionally, the difficulty of state determination due to the lack of traditional reference systems requires a guidance, navigation, and control (GNC) pipeline that ideally is both computationally and fuel-efficient, and that incorporates a robust state determination system. In this paper, we propose an end-to-end algorithm utilizing neural networks to generate near-optimal control commands from raw sensor data, as well as a hybrid model predictive control (MPC) guided imitation learning controller delivering improvements in computational efficiency over a traditional MPC controller.
Runway vs. Taxiway: Challenges in Automated Line Identification and Notation Approaches
Ganeriwala, Parth, Alvarez, Amy, AlQahtani, Abdullah, Bhattacharyya, Siddhartha, Khan, Mohammed Abdul Hafeez, Neogi, Natasha
The increasing complexity of autonomous systems has amplified the need for accurate and reliable labeling of runway and taxiway markings to ensure operational safety. Precise detection and labeling of these markings are critical for tasks such as navigation, landing assistance, and ground control automation. Existing labeling algorithms, like the Automated Line Identification and Notation Algorithm (ALINA), have demonstrated success in identifying taxiway markings but encounter significant challenges when applied to runway markings. This limitation arises due to notable differences in line characteristics, environmental context, and interference from elements such as shadows, tire marks, and varying surface conditions. To address these challenges, we modified ALINA by adjusting color thresholds and refining region of interest (ROI) selection to better suit runway-specific contexts. While these modifications yielded limited improvements, the algorithm still struggled with consistent runway identification, often mislabeling elements such as the horizon or non-relevant background features. This highlighted the need for a more robust solution capable of adapting to diverse visual interferences. In this paper, we propose integrating a classification step using a Convolutional Neural Network (CNN) named AssistNet. By incorporating this classification step, the detection pipeline becomes more resilient to environmental variations and misclassifications. This work not only identifies the challenges but also outlines solutions, paving the way for improved automated labeling techniques essential for autonomous aviation systems.
Deep Learning Based Dynamics Identification and Linearization of Orbital Problems using Koopman Theory
Nehma, George, Tiwari, Madhur, Lingam, Manasvi
The study of the Two-Body and Circular Restricted Three-Body Problems in the field of aerospace engineering and sciences is deeply important because they help describe the motion of both celestial and artificial satellites. With the growing demand for satellites and satellite formation flying, fast and efficient control of these systems is becoming ever more important. Global linearization of these systems allows engineers to employ methods of control in order to achieve these desired results. We propose a data-driven framework for simultaneous system identification and global linearization of both the Two-Body Problem and Circular Restricted Three-Body Problem via deep learning-based Koopman Theory, i.e., a framework that can identify the underlying dynamics and globally linearize it into a linear time-invariant (LTI) system. The linear Koopman operator is discovered through purely data-driven training of a Deep Neural Network with a custom architecture. This paper displays the ability of the Koopman operator to generalize to various other Two-Body systems without the need for retraining. We also demonstrate the capability of the same architecture to be utilized to accurately learn a Koopman operator that approximates the Circular Restricted Three-Body Problem.
Autonomous Rendezvous with Non-cooperative Target Objects with Swarm Chasers and Observers
Mahendrakar, Trupti, Holmberg, Steven, Ekblad, Andrew, Conti, Emma, White, Ryan T., Wilde, Markus, Silver, Isaac
Space debris is on the rise due to the increasing demand for spacecraft for com-munication, navigation, and other applications. The Space Surveillance Network (SSN) tracks over 27,000 large pieces of debris and estimates the number of small, un-trackable fragments at over 1,00,000. To control the growth of debris, the for-mation of further debris must be reduced. Some solutions include deorbiting larger non-cooperative resident space objects (RSOs) or servicing satellites in or-bit. Both require rendezvous with RSOs, and the scale of the problem calls for autonomous missions. This paper introduces the Multipurpose Autonomous Ren-dezvous Vision-Integrated Navigation system (MARVIN) developed and tested at the ORION Facility at Florida Institution of Technology. MARVIN consists of two sub-systems: a machine vision-aided navigation system and an artificial po-tential field (APF) guidance algorithm which work together to command a swarm of chasers to safely rendezvous with the RSO. We present the MARVIN architec-ture and hardware-in-the-loop experiments demonstrating autonomous, collabo-rative swarm satellite operations successfully guiding three drones to rendezvous with a physical mockup of a non-cooperative satellite in motion.
Performance Study of YOLOv5 and Faster R-CNN for Autonomous Navigation around Non-Cooperative Targets
Mahendrakar, Trupti, Ekblad, Andrew, Fischer, Nathan, White, Ryan T., Wilde, Markus, Kish, Brian, Silver, Isaac
Autonomous navigation and path-planning around non-cooperative space objects is an enabling technology for on-orbit servicing and space debris removal systems. The navigation task includes the determination of target object motion, the identification of target object features suitable for grasping, and the identification of collision hazards and other keep-out zones. Given this knowledge, chaser spacecraft can be guided towards capture locations without damaging the target object or without unduly the operations of a servicing target by covering up solar arrays or communication antennas. One way to autonomously achieve target identification, characterization and feature recognition is by use of artificial intelligence algorithms. This paper discusses how the combination of cameras and machine learning algorithms can achieve the relative navigation task. The performance of two deep learning-based object detection algorithms, Faster Region-based Convolutional Neural Networks (R-CNN) and You Only Look Once (YOLOv5), is tested using experimental data obtained in formation flight simulations in the ORION Lab at Florida Institute of Technology. The simulation scenarios vary the yaw motion of the target object, the chaser approach trajectory, and the lighting conditions in order to test the algorithms in a wide range of realistic and performance limiting situations. The data analyzed include the mean average precision metrics in order to compare the performance of the object detectors. The paper discusses the path to implementing the feature recognition algorithms and towards integrating them into the spacecraft Guidance Navigation and Control system.
Autonomous car arrives at Florida Poly to enhance research at new facility - Tampa, Florida - Eminetra
Lakeland, Florida-Researcher at Florida Institute of Technology Advanced Mobility Institute We are starting a new phase of work on self-driving car testing and verification. The study is moving from software testing to hardware testing at a new on-campus simulation facility, partially funded by a $ 350,000 grant from the National Science Foundation. The highlight of the project, the deceived autonomous Ford Fusion sedan, has recently arrived in Florida Poly. The car is equipped with sophisticated electronics and has been transformed into a drive-by-wire autonomous test vehicle. "Drive-by-wire means that electronic signals can control steering, acceleration, and braking," said Dr. Onur Toker, an associate professor and researcher in electrical and computer engineering.
PIM: A Novel Architecture for Coordinating Behavior of Distributed Systems
Process integrated mechanisms (PIM) offer a new approach to the problem of coordinating the activity of physically distributed systems or devices. Current approaches to coordination all have well-recognized strengths and weaknesses. We propose a novel architecture to add to the mix, called the Process Integrated Mechanism (PIM), which enjoys the advantages of having a single controlling authority while avoiding the structural difficulties that have traditionally led to its rejection in many complex settings. In many situations, PIMs improve on previous models with regard to coordination, security, ease of software development, robustness and communication overhead. In the PIM architecture, the components are conceived as parts of a single mechanism, even when they are physically separated and operate asynchronously.
Human-Centered Cognitive Orthoses: Artificial Intelligence for, Rather than Instead of, the People
Neuhaus, Peter (Florida Institute for Human and Machine Cognition (IHMC)) | Raj, Anil (Florida Institute for Human and Machine Cognition (IHMC)) | Clancey, William J. (Florida Institute for Human and Machine Cognition (IHMC))
This issue of AI Magazine includes six articles on cognitive orthoses, which we broadly conceive as technological approaches that amplify or enhance individual or team cognition across a wide range of goals and activities. The articles are grouped by how they relate to orthoses enhanced socio-technical team intelligence at three different cognitive levels—sensorimotor physical, professional learning, and networked knowledge.
Calendar of Events
(EDOC 2005). Moscow State University, Russia, King's Email: patrick.hung@uoit.ca In cooperation with the American Association for Artificial Intelligence General Chairs The 19th International FLAIRS Conference (FLAIRS 2006) will be held May 11-13 Philip Chan, Debasis Mitra 2006, in Melbourne Beach, Florida, USA. Coast" (centered around NASA's Kennedy Space Center), and has easy access to Florida Institute of Technology Orlando and the Disney World attractions. Submission of papers for presentation at the conference is now invited.